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[57] ABSTRACT 

A display system receives a data stream having successive 
image frame data in frame regions and Internet Universal 
Resource Locator (URL) data and association data in data 
regions between frame regions, and displays on a display 
monitor successive frames derived from the image frame 
data. The association data associates one or more image 
entities in successive frames with one or more URLs, and a 
viewer, by selecting an associated image entity in the 
display, causes the system to access the Internet, to connect 
to a source on the Internet associated with the URL, to 
download a WEB page from the source, and to display the 
WEB page in the display. The viewer may interact with the 
displayed WEB page to access further related information. 
Entities may be enhanced in the display to indicate associa- 
tion with a hidden URL. 

34 Claims, 6 Drawing Sheets 
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INTEGRATION OF DYNAMIC UNIVERSAL rate TV presentations may be made in separate windows, or 

RESOURCE LOCATORS WITH TELEVISION overlaid windows on the display screen. Separate windows 

PRESENTATIONS may also support display from separate sources, such as an 

analog TV program in one window, a computer game in 

FIELD OF THE INVENTION 5 another, and a video conference in a third. 

_ . r J- Still, with all of the digital techniques made available, an 

Hie presen imvention is m the area of multimedia appa- ^^^^^^ ^^^^^^^^ ^^^^.^ l^^^^^^ ^ 

ratus and methods, and pertains more parUcularly to intc- ^^^^^ ^ ^^.^ ^ ^^^^^ 

graung Memet access with TV trai^mission and display to ^ ^^^^ ^^^^^ information occurs to an end user, 

provide TV viewers with supplementary information regard- ^ ^ ^ .^^^^^^ ^ ^^^^^^^^ 

mg displayed enUties and the Idee. performer. TTie viewer may not remember the performer's 

BACKGROUND OF THE INVENTION "^^bt be very interested for a time in recalling the 

name, and even in gathering further information about the 

With continuing development of new and better ways of actor or actress, 

delivering television and video presentations to end users, 15 Conventionally in this situation, the viewer can wait until 

and parallel development of computerized information the end of the program, where the credits are typically 

systems, such as the Internet and the associated World Wide displayed, usually unreadable, note the name of the 

Web (WWW), there have been concerted efforts to integrate performer, then (assuming an integrated system) switch 

various systems to provide enhanced information and enter- modes to Browse, access the WWW, and search the per- 

tainment systems. For example, developers are introducing 20 former's name, the studio name, the program name, or some 

integrated systems combining TVs with computer other criteria, to seek the desired information. If the infor- 

subsystems, so a TV may be used as a WEB browser. mation desired is available somewhere in a WEB page or 

In some systems computer elements, such as a CPU, related database, the user may, after some effort, be able to 
memory, and the like, are built into the familiar chassis of a satisfy his/her desire for the information. 
TV set. In such a system, the TV screen becomes the display ^ One more simple example should suflBce. Given a TV 
monitor in the computer mode. In such a system, conven- advertisement, a viewer may be thoroughly enamored by an 
tional TV elements and circuitry are incorporated along with advertisement for a particular item such as an automobile, 
the computer elements, and capability is provided for a user and wish to purchase the item or one much like it. Given the 
to switch modes. One may thus, with a properly equipped cost of network television advertising, and the necessary 
system, select to view analog TV programs, digital TV time limitations imposed on purchasers of advertising time 
programs, conventional cable TV, satellite TV, pay TV from as a result, the depth of information provided about pur- 
various sources, and browse the WWW as well, displaying chasing an advertised item is necessarily limited. Certain 
WEB pages and interacting with on-screen fields and rela- salient features may be provided, typically those that an 
tional systems for jumping to related information, databases, advertiser presumes will attract a purchaser, and some 
and other WEB pages. general pricing information may be provided as well. 

In some other systems, computer elements are provided in Assuming an automobile advertisement as an example, 

an enclosure separate from the TV, termed in the art a set-top full detail of options, models, availability, pricing and 

box. Set-top box systems have an advantage for providers in financing details, and where one might go locally to examine 

that they may be connected to conventional television sets, ^ and test drive a model of the car could not be provided, 

so end users don't have to buy a new TV along with the Moreover, even if full detail were provided, the viewer 

computer elements. would have a hard time trying to write it all down for future 

In such integrated systems, whether in a single enclosure use. See, for example, the fine print on automobile lease 

or as set-top box systems, user input is typically through a advertisements. 

hand-held device quite similar to a familiar remote 45 In most cases a viewer sold by a TV advertisement has to 
controller, usually having infra-red communication with the make some determined effort to actually complete a pur- 
set-top box or a receiver in the integrated TV. For computer chase of the advertised item, except for the questionable case 
mode, such as WEB browsing, a cursor is displayed on the of TV shopping channels, which are not presumed by many 
TV screen, and cursor manipulation is provided by buttons to be credible. Moreover, many major manufacturers do not 
on the remote. Select buttons are also provided in the remote 5Q offer products to be sold by the conventional phone-in TV 
to perform the familiar fimction of such buttons on a pointer shopping technique. 

device, like a mouse or trackball more familiar to computer What is clearly needed is a further integration of the 

users. techniques of WEB browsing and TV transmission to pro- 

Set-top boxes and computer-integrated TVs adapted as vide a method and apparatus for a viewer to very quickly 

described above typically have inputs for such as a TV 55 garner maximum information about entities of interest seen 

antenna (analog), cable TV (analog or digital), more recently in TV transmissions. A method allowing a viewer to quickly 

direct-satellite TV (digital), and may also connect to mass and easily access information in detail about products adver- 

storage devices such as hard disk drives and CD-ROM tised at a more general level, and about people and things of 

drives to provide a capability for uploading video data from interest identified in TV transmissions, 

such drives and presenting the dynamic result as a display on 50 „ ™ ^ 

the TV screen. SUMMARY OF THE INVENTION 

The present inventors have noted that with the coupling of In a preferred embodiment of the invention a varying 

computer technology (digital) with TV, many capabilities signal for providing a display on a display monitor is 

famiUar to computer users have been made available to TV provided, comprising a first region comprising image infor- 

uscrs. For example, ability to provide text annotation for TV 65 mation for a single frame for the display; and a second 

presentations is considerably enhanced. Computer tech- region separate from the first region, the second region 

niques such a Pix-on-Pix are now available, wherein sepa- comprising information relating a visual entity in the display 
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provided by the information in the first region to an Internet the image frames. There may also be more than one URL 

Universal Resource Locator (URL). The second region may each associated with a different image entity. Visual 

also comprises information relating the visual entity to a enhancement of the image entity in a display provided by the 

specific position in the single frame display. The signals in data stream may be provided as well, such as by one or more 

the first region may be either analog or digital in nature. The 5 of adjusting brightness, contrast, or color, 

second region may also comprise information for causing In another aspect a method is provided for association of 

the visual entity to be visually enhanced in the display, such an entity in a broadcast image with an Internet Universal 

as by alteration of contrast, brightness, or color signals, or Resource Locator (URL), comprising steps of (a) preparing 

some combination of these, ^. ^^'^""^ ^^^Y^^S ^^^^^ ^^^^ regions cornprising sequen- 

. ^ r rr^r in tial fnime data from a scene usmg a visual unagmg appa- 

In an alternative embodiraen a system IS provided for TV lo .^^^^^.^^ ^^^^ ^^^^^ ^^^^^ 

transmission and display of television programming, com- between the frame data regions; and (c) inserting data 

prising a source providing a data stream having image frame ^gj^^ng ^rl to a specific entity in an adjacent frame 

data m one region and a dynamic Internet Universal ^^ja region in the second regions between the frame data 

Resource Locator (URL) in a separate region, the URL regions 

related to an image entity in a display provided by the image is ^^^^^ performed 

frame data; and receiving and display apparatus adapted for pre-recorded image data. or. alternatively, steps 

receiving and displaying the image frame data on a disp ay performed automatically in a live broadcast by computerized 

monitor, the receiver and display apparatus compnsmg also ^^ coordinated with the visual imaging apparatus, 

an Internet Browser. In this embodiment the receiver strips .j^^^^ additionaUy be a step for inserting data in the 

the URL from the region separate from the region compris- M ^^^^ enhancing display of the entity, 

mg the ime^e frame data, activates the Inlemel Browser, ,^ ^ ^^^^ ^ ^^^.^^^ associating 

accesses a World Wide Web home page associated With the f., . . . * 

TTUT J J- 1 .u u *u J- 1 •* an entity man image displayed from a broadcast data stream 

URL, and displays the home page on the display monitor. ^ ,f . niuj\ 

' ^ ^ ^ ^ with an Internet Universal Resource Locator (URL), com- 

In the system embodiment just described, the JJRL may ^^^^^^^ ^^^^^ displaying image frames derived from a 

bc^ssociated ^ an image enUty in a frame displayed from ^^j^ ^^^^^^ ^^^-^^ ^^^^^ ^^^^^ ^ata; (b) acquiring the URL 

th e image^ffamc data or more than one entity may be association data from data regions separate from but 

associated each wiih a different URL Also the image entity interleaved with the image frame data; and (c) associating 

may be enhanced m the display to indicate to a viewer that ^^^^^^ ^ successive image frames with the acquired URL 

the entity is associated with a URL. Enhancement can be by according to tiie association data. 

one or more of adjusting brightness or contrast, by adjusting ^^^^^^ ^^^^^ ^ ^^^^^^ ^^^^^ 

color, or by adding an outhne to the cnUty. enhancing the entity in the successive image frames such as 

The source m such a system may be a broadcast trans- adjustment of one or more of color, brightness, or 

mitter broadcasting a TV signal, a Video Cassette Recorder contrast in the display 

(VCR) playing a VCR tape, a CD-ROM drive playing a ^^^^ ^ ^^^^^^^ ^ invention a method is 

CD-ROM disk, or a computer apparatus retnevmg and -^^^ accessing additional information related to an 

transmitung a data stream from a hard disk dnve. The WEB • ^ ^-^^^ comprising steps of (a) 

page retrieved and displayed nciay take up the entire display, ^^^ialing the image entity with a dynamic Universal 

or may be displayed as a movable and adjustable window on Resource Locator (URL) transmitted between frames in a 

the display monitor. ^ ^^^^ stream including image frames for the video display; 

In other embodiments a receiving and display apparatus is q^^ selecting the entity in the video display by user input: (c) 

provided comprising computerized control circuitry; data accessing the Internet via a Network Interface Modide 

stream receiving and processing circuitry; an Internet (JSIM) in response to the user input, and connecting to the 

browser; display circuitry; and a display monitor. The data source associated with the URL; (d) downloading a 

receiving and processing circuitry receives a data stream 45 WEB page from the data source; and (e) displaying the WEB 

having image frame data and an Internet Universal Resource p^ge in the video display. 

Locator (URL) identifying an Internet source and provides fu^her method provided the WEB page may be 

the unage frame data to the display circuitry and the URL to displayed in the video display as a movable and adjustable 

the control circuitry. The display circuitry provides a display window, or may take up the entire display. Us er selecti on is 

on the display monitor from the image frame data, and the 50 preferably by cursor manipul ation and selection "with a 

control circuitry accesses the Internet, causes Uie Browser to poiS^Ta^ e. Multlplti image entities may be a^ ciated 

access the Internet source, and downloads and displays a each with a unique y RL. and more than one WEB page may 

WEB page from Uie Internet source. accessed and displayed by selecting more than one image 

In this receiving and display apparatus the IIRT^ ir ajwn- entity, 

ci ated with a specific entity ima^e in the display. There may 55 The present invention in its many aspects and embodi- 

also be muluple UKLs associated each with a different nients provides a very user-friendly ability to access infor- 

spccific entity image in the display. The WEB page retrieved n^^tion not normaUy provided in television and other video 

is displayed as a movable and adjustable window in the displays, and affords a new tool for advertisers and promot- 

display in a preferred embodiment, but may also be dis- jj conveniently bypasses time-consuming and labo- 

played in place of the previous display. eo rious tasks for a viewer who wishes additional information 

In another aspect of the invention a signal preparation and from such displays and presentations, 

transmission apparatus is provided comprising imaging prtpf nP^JPRiPTiOM OF THF DR AWfNfiS 

apparatus for monitoring a scene and preparing a signal data ^^^^^ DESCRIPTION OF THE DRAWINGS 

stream therefrom, the data stream comprising image frame FIG. 1 is a block diagram of a set-top box as may be used 

data; and control circuitry adapted for adding an Internet 65 as a platfonn for practicing the present invention. 

Universal Resource Locator URL to the data stream and for FIG. 2 A is an exemplary TV display according to an 

associating the URL with an image entity in one or more of embodiment of the present invention. 
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FIG. 2B is a representation of a data stream for transmit- Set-top box 11 has a ROM 47 for such as BIOS functions, 

ting a TV display in an embodiment of the invention as and also dynamic random access memory (DRAM) 49. 

shown in FIG. 2A- Operating code 4S, stored in DRAM 48, provides function- 

FIG. 2C is an exemplary display showing a WEB page in ality according to embodiments of the invention, and may be 

a window on a TV display as might be presented as a result 5 recorded in any conventional manner accessible and execut- 

of practicing the present invention. able by CPU 19. Code 48 includes a WEB browser, and 

FIG. 3A is a flow diagram depicting steps in preparing a "^"^"^^ ^P^^^^ functionaUty according to embodiments 

TV transmission according to an embodiment of the present ^he mvention, descnbed more fully below. The WEB 

invention browser is adapted to access servers on the WWW, such as 

t7rr> 113 ;^ « fl«„, . 10 server 54 shown connected to link 37. Server 54 is meant to 

FIG. 3B is a now diagram depictmg steps in receiving a ^ A,n-r> . i_ j- i j i_ 

TV broadcast with a dynamic URL, in initi^ating access to a 7''^"' ^^.^t^tbat may be dialed "P through one 

WEB page according to an embodiment of the present °^ ""e modems associated with the system of FIG. 1. 

invention. apparent to those with skill in the computer arts 

that the communication links indicated in FIG. 1 for set top 
DESCRIPTION OF THE PREFERRED 15 box 11 are illustrative of data flow, and are not meant to 
EMBODIMENTS indicate the type or bandwidth of specific links. It is well 
In embodiments of the present invention, individual kno^^' fo** example, that CPUs of the sort described corn- 
images in TV presentations, such as persons, objects, and the municate on parallel buses with bus cycles controlled by bus 
like, are linked with Universal Resource Locators (URLs) in controUers in an industry standard fashion, such as an ISA 
a manner that a viewer may select such images, and by so t"^. ^n EISA bus, and the like. Other sorts of communica- 
doing, invoke a linked URL, which leads to a WEB location ^on links may be used, such as Universal Serial Bus (USB) 
providing infonmation related to the image. In most embodi- others. 

ments of the invention an image related to a URL is In the set-top box of FIG. 1, VGA circuitry 33 has outputs 

enhanced in display, such as by a special color, an enhanced finks 20 and 22 for driving a TV 51 and/or a computer 

brightness (a halo), or an outline. Other forms of enhance- ^ display monitor 53, and display in various embodiments 

ment are possible as well. may be made on either or both. There is also an infra-red 

FIG. 1 is a block diagram of a set-top box 11 as may be cominunicating remote 63 adapted for conventional remote 

used for practicing the present invention. Set-top box 11 is functions and also for cursor control and selection by 

more sophisticated and has more functionality than required directional buttons 67 and selection buttons 69. Infra-red 

for practicing the invention in some embodiments, but communication from remote 63 is to receiver 65 in the 

serves as a good example of the sort of platform that may be set-top box. 

used. As is well known in the art, data stream transmissions 

In box 11 a decoder/tuner 13 receives signals from a made for the purpose of presenting images on a display 

variety of sources, such as a satellite link 15, a cable TV line 35 screen are sent in identifiable frames. This is generally true 

17, and a VCR input 16. An 80486 CPU 19 in this embodi- whether the origination is a stored (pre-recorded) data 

ment provides management and computing ability, and is stream, or a live transmission, and whether the transmission 

connected to decoder/tuner 13 by link 21. In other embodi- ^ digital or analog. The specific technology in any case is 

ments other CPUs may be used. Decoder/tuner 13, accepts very well known in the art, and not necessary to cover in 

and decodes satellite signals on link 15, Cable TV signals on 40 detail in this specification. 

line 17, and VCR video signals on line 16. In frame-by-frarae transmissions, as is known in the art, 

In addition to the CPU and decoder/tuner in set-top box it is known to transmit information in the space between 

11, there is a Motion Picture Experts Group (MPEG) frames. The format of digital transmissions allows for such 

decoder 25 for interpreting data provided to the set top box data, and analog TV transmission has blank lines between 

in MPEG I and MPEG II format, or future formats, and for 45 frames which may also be used for data transmission within 

providing signals therefrom to drive a TV or a video certain space and time limitations. Information for coloriz- 

monitor. MPEG is an industry standard protocol for video ing black-and-white TV presentations is coded in this 

data, and is well known in the art. manner, as are special captions for hearing handicapped, for 

MPEG decoder 25 is coupled to CPU 19 by hnk 27 and example, 

to decoder/tuner 13 by link 29. MPEG decoder 25 has an 50 In various embodiments of the present invention one or 

output line 31 to a video graphics adapter (VGA) chip or more entity images in frames of a transmission are identified 

chip set 33, including video ram (VRAM). The VGA chip as to position and extent in the frame, and are associated 

set is adapted for driving a TV screen or a computer display with a WWW URL. As a simpUfied example, in an advcr- 

scrcen via conventional circuitry. Other sorts of video cir- tisement for a certain brand of automobile, an icon or 

cuitry might be used. 55 emblem may be presented in each frame at a particular 

An analog telephone modem 35 connects to a telephone position in the frame. The emblem could be, for example, the 

line 37 and to CPU 19, providing communication with a specific emblem used for that brand of automobile, like the 

remote location for pay-TV transactions and diagnostic and well-known Ford™, Chevrolet™, of BMW™ emblem. The 

downloading services. An optional ISDN interface 39 in this emblem could be provided in the advertisement in any of the 

embodiment connects to an optical digital data cable 41 and 60 conventional manners known in the art. FIG. 2 A is a 

to CPU 19 for digital telephone communication, which may simplified depiction of a firame 55 displayed with a BMW 

be used instead of or in addition to analog modem 35. There emblem 57 in the frame at a particular position with a 

are optional interfaces provided also for a compact-Disk specific areal extent. 

Read-Only Memory (CD-ROM) drive 43 and a hard disk In this example the BMW advertisement is a pre-recorded 

drive 45. The modems depicted here are convenient, and are 65 advertisement that may be transmitted any number of times 

examples of Network Interface Modules (NIMs) that may be and displayed, just as advertisements are typically displayed 

used for Internet access. between portions of TV programs. In the recording of the 
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advertisemeDt, or in an editing procedure for existing pre- Once a viewer activates the system of the invention, and 

recorded advertisements, data is recorded to be transmitted connection is made to the BMW WEB server, action may 

between frames identifying the position and extent of the proceed in one of several ways. In one embodiment, the TV 

BMW emblem in the adjacent frame, and associating the display is suspended, and the initial WEB page downloaded 

emblem with a specific WWW URL, of the general form 5 from the BMW server is displayed instead. Preferably, the 

http://www.bmw.com. The URL is a locator on the WWW TV display continues, and the WEB page downloaded is 

for a Home Page provided on a WEB server maintained by displayed in a window 71 over the TV display as shown in 

BMW, and being a repository for detailed information in FIG. 2C. In this manner, window 71 can be enlarged or 

addition to that provided in the transmitted advertisement. downsized, moved on the screen, and closed whenever the 

In altemative embodiments of the invention different lO viewer wishes. Also, interactive areas in the window relating 

entities in the a frame may be associated with different additional information or related WEB pages can be 

URLs, and may serve to direct the user to difiEerent home activated with cursor 70 and selector buttons 69, just as 

pages on the WEB, or to different data locations on the same though the WEB page in the superimposed window is a page 

home page. The car itself may be highlighted and associated displayed on a computer monitor via a conventional WEB 

with a URL as well as the emblem, and the car URL could 15 browser. This capability includes ability to scroll via scroll 

lead to information on the latest model, in this example, bars and the like as commonly presented with WEB pages 

perhaps http://www.bmw.com/latestmodel. on the WWW. In some embodiments, due to areal limita- 

FIG. 2B is an illustration of a data stream 59 wherein data "^^'P^^'^" ^ ^'^^ ^ ' 

for a first frame 61 and a second, following frame 65 is ^"^^y^ '^e WEB page is mamtamed at a certain mim- 

separated by a data region 63 containing the data identifying T™^^^' ^- '"^f}^ ^!^*^^ ^^.f}^^ 

the position and extent of BMW emblem 57 in frame 61. A J^EB page scannmg and panmng capabdity is provided as 

next data region 67 follows frame 59 and identifies the ^nown m the art for accessmg the entire page, 

position and extent of the BMW emblem in that frame as The BMW WEB page shown in window 71 of FIG. 2C is 

well, and carries the URL associated with the emblem as an information portal for the TV viewer to access an 

well. In this manner each frame has an associated data ^ abundance of information via the WWW, but not available 

region with the image position and extent data, and the ^ original TV advertisement. Such information might 

associated URL. include, for example, colors available (with examples)., 

In conventional reception systems, wherein computer body styles (with pictures), performance data, detailed pric 
capabihty is not provided integrated with the TV capability, ^^^^^^^^^ f ^^^^ available, locations near 
the additional data including the URL is not utilized, and '° the viewer where a demonstration dnve may be accom- 
passes transparently, as the data is between frames, and only P^^*^^ f ^ ^'"P^y representatives may be interviewed, 
the frame data is utilized in such conventional TV-only fnd much more. Even demonstraUve videos may be down- 
systems. However, in a system of the sort described with the 1°^^^ f Pl^X^^ .^i^^?,^' ^ the system is equipped 
aid of FIG. 1., wherein computer frinctions have been „ ^^^f^f information Further, and miportanUy, a 
integrated with TV funcUons, the data between frames can p-fiUed order form may be accessed. The process of 
be utilized in a special way. ^^y^"S ^ ^^^^^^^ ^ P'"^"'^* painless and user/ 

In a system with a CPU and a memory, and also equipped ^^Y®^ friendly, 

with special control routines according to an embodiment of 1° addition to simply accessmg additional information, 

the invention, the BMW emblem is treated as an interactive ^ two-way capabihty of Internet hnks allows a viewer, 

screen region m a manner familiar to persons who use access through WEB page access, to send information to the server 

WEB pages. The computer system integrated with the TV ^tiput fields, assummg, of course, that the system at the 

circuitry displays a cursor 70 on the screen which may be viewer's command has text input capabihty, such as at least 

positioned by a user via positioning buttons 67 on hand-held ^ minimum keyboard. 

remote 63 (see FIG. 1). In other systems, cursor control may 45 The example presented herein of a BMW automobile 

be accomphshed by a pointer device or in another conve- advertisement is but one special application in the scope of 

nient manner. the invention. In variations of this embodiment, the image 

Continuing with the example of the BMW advertisement, ^^^^0° associated with an URL could be an image of the car, 

as the TV frames are displayed, which includes BMW '^^^^ emblem The active image region 

emblem 57, a viewer may activate the cursor (cursor may 50 could move in the presentaUon of the TV advertisement, and 

activate automaticaUy when the viewer manipulates one or ^he interframe data would track the screen position and 

another of buttons 67). Following special control routines ^^t^^t' ^. ^^^or movement could by coordmated with the 

according to an embodiment of the invention, data between dynamic image m real time. 

frames is stripped and used in execution of the control In addition to tracking and coordinating a dynamic image, 

routines to identify the position and areal extent of emblem 55 dynamic image may be enhanced in the display in a 

57 in the adjacent frames, and the associated URL. manner to indicate to the viewer that the dynamic image is 

If the viewer is interested in additional information, a related region for access for further information. Th^ may 

he/she may manipulate the cursor to touch the region of done by outhnmg in some fashion on the screen, bnght- 

emblem 57 and then actuate a selection signal, such as "^^s and or contrast adjustment, color variation, or some 

pressing one of the buttons 69 on the remote. On receipt of 60 combmaUon of these or other techmques. 

the selection signal with the cursor touching the BMW In this manner any image in a TV transmission may be 

emblem, the system executes browser routines, accessing associated, according to embodiments of the present 

the WWW, and dials up the WEB server (see server 54 and invention, with a dynamic URL for accessmg additional 

modem 35 or 39, FIG. 1) described above maintained by information related to the image. 

BMW on the WWW. The URL in the data region between 65 In a minimum embodiment, a URL may be associated in 

frames of the TV transmission, associated with the BMW an interframe region, as described above, and, upon sclec- 

emblem is the WWW address for dial-up, tion of the image, the URL may be displayed on the screen 
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as text informatioQ for the viewer to remember or copy. The the WEB page in general in any or all of the ways known to 

URL may also be downloaded to a memory device for later those with skill in the art. At step 115 the viewer deactivates 

printout or use in browsing. the WEB display, which may be done by selecting a familiar 

■aere are an almost endless list of adaptations and °' °f ^''^'^ '^dis- 
embodiments of this invention. The example of the BMW 5 niques. 

advertisement is a commercial appUcation, and one may Th^ descnptions above relate prmapally to pre-recorded 

imagine a multitude of such commercial advertising appU- presentaUons for TV display, such as advertisemenls, pro- 

7^ c 1^1- grams to be delayed and repeated and the bke. la such 

material editing may be done frame-by-frame adding the 

I n other embod iments, for example, m TV programs other few bytes of information needed in between frames to relate 

t han advcrg scments, actors and actresses may be asy^cigted qj. more images in adjacent frames to a URL. Methods 

with UKC swhicb will lead to WEB pages with inform ation iq accomplish such editing will be apparent to those with 

such as other movies or presentations featuring the same skill in the TV and data transmission arts. Similar techniques 

person, biographical information, availability and prefer- may be used with VCR media and CD-ROM media. No 

ences for additional work (for agents and the like). In known method of recordiag and disseminating still or 

politics, positions on issues, coming rallies and campaign dynamic images for subsequent image display arc excluded, 

stops, and the like may be accessed from political spots MPEG data formats, for example, include means for includ- 

having an active region according to the invention. In sports ing such data. 

events, information about particular athletes may be FIG. 3B is a flow diagram depicting general steps for 

provided, and information about schedules, upcoming preparing a TV transmission with a dynamic URL according 

contests, records, chances of playoff positions, and the like to an embodiment of the present invention. At step 73 an 

may be presented. Sp orts organiza tions may also present entity, such as the BMW emblem in the example above, is 

se ason ticket prices and the lik e, and even aecompli afa-^ es identified in a scene to be broadcast, to be associated with a 

ov er Internet hnks. dynamic URL. 

FIG. 3Ais a flow diagram depicting a procedure followed At step 75 the identified entity is associated with a URL. 

by an apparatus in conjunction with a data stream containing ^ The URL will in most cases be for a WEB page maintained 

a dynamic URL in conjunction with an embodiment of the for the purpose of providing additional information related 

present invention. to the identified entity, or associated with the TV broadcast 

At step 83 a data stream is received bearing entity data in a more general way 

and one or more dynamic URLs in a data region separate s^^P "77 the location and, in many cases, the areal extent 

from image frame data. The one or more URLs are linked to of the identified entity is identified for a broadcast frame 

the image entities by a tag. The URLs can be sent before relative to frame geometry. That is, the position and extent 

(ahead of) the images and stored in a cache. Thus, when of the entity on a display screen. 

many images are displayed at the same time, more band- At step 79 data defining the position and areal extent of 

width can be alloated to the entities, as opposed to the URL the identified entity, and a URL to be associated with the 

data. entity, is recorded in a data region separate from the image 

At step 85 interframe data is stripped and provided to data for display frame in the data stream for a broadcast. The 

computer elements in the receiving platform (see FIG. 1) to separate data region is associated with the frame, 

a CPU executing dynamic URL control routines according In step 81 steps 1-4 are repeated for all frames wherein an 

to an embodiment of the present invention at step 87. A 4q entity is to be associated with a dynamic URL. In most cases 

normal TV picture is presented from the frame data at step one entity wfll be repeated in a relatively large number of 

89 by the conventional TV elements of the receiving inter- frames, so a viewer wiU have time to react and select a 

active system. dynamic entity. In a single program or broadcast several 

At step 91 data from the inter-firame regions is processed entities may be thus associated with a single, or with several 

to enhance the identified entity, and the enhancement is 45 URLs. 

accomplished at step 93. At step 95 a viewer provides Any entity is a candidate, and there are many possibilities, 

pointer input to activate and manipulate a cursor on the TV People may be selected, objects or artifacts, or added icons 

screen. The input is processed at step 97, and at step 99 the or images for example. In some cases the entity to be 

viewer moves the cursor to the area of the enhanced entity identified and associated with a URL is actually added to the 

image. At step 101 the viewer activates a selection input, 50 scene by added data in the same region iised for the URL. 

which is processed at step 103, and at step 105 the enhanced In some embodiments as well, a single (point) position is 

entity is selected. This selection initiates WEB access by identified for an entity, and a general area, such as a circular 

computer elements in the receiving and display system. area or a rectangular area is associated with the entity, to be 

At step 107 a Network Interface Module (NIM) is ini- the area which a viewer may select to initiate a dynamic 

tialized and dial-up is accomplished, providing Internet 55 URL, 

access for the receiving system. The NIM may be an analog The invention is not limited to pre-recorded and edited 

or a digital modem, a cable modem, a satellite modem, one image data. Unique methods may be employed to provide 

of computer network cards, such a lObT, lOObT, Token the advantages of the present invention in live broadcasts, 

Ring, or any of a number of other ways to access the such as sports events and the like. In live broadcasts the data 

Internet. 60 between frames, including a URL associated with an image, 

At step 109 the dynamic URL associated with the has to be inserted in substantially real time, or with a 

enhanced entity is presented on the Internet, and the asso- minimum delay. This means that the transmission 

ciated WEB page is downloaded. The WEB page is dis- equipment, meaning a camera and associated image and data 

played at step 111, either as the display or as a window on processing apparatus, has to have a way of knowing which 

the display. Step 113 represents further action the viewer 65 object or person being imaged is to be an URL-associated 

may take with the WEB page, selecting related information, object or image, and the apparatus has to develop the data to 

jumping to related sites on the WWW, and interacting with be inserted firamc -by-frame. 
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To accx3inplish real-time live broadcasts with dynamic 
URLs, an object or a person to be URL associated simply 
needs to be equipped with an apparatus capable of informing 
the separate imaging apparatus of the fact of association and 
position. In one embodiinent this apparatus takes the form of 
a broadcaster, such as an infra-red transmitter or a radio 
beacon broadcaster. 

A broadcast device as described accomplishes two essen- 
tial purposes in transmission to the imaging apparatus. The 
first is positional, so the imaging apparatus may insert 
positional and areal extent data in the interframe region 
devoted to such information, and the second may be the 
URL itself. In some embodiments, the URL may be inserted 
automatically, as the URL will be common to an event rather 
than an object or person. In others, the URL is added specific 
to a tracked object or person. In the case of real-time live 
broadcast, the technique mentioned above, wherein a point 
location is identified and a standard areal extent is inserted, 
is a convenient method. 

There are a number of convenient ways that the necessary 
information for dynamic URL inclusion may be provided by 
a person or an object being imaged by such as a TV camera. 
Infra-red and radio beacon are just two of many. In some 
embodiments bar codes on a players clothing may be used, 
the codes readable by the imaging apparatus. In others, 
alternative broadcast techniques may be used, such as 
X-Rays or UHF transmissions. Any method of transmitting 
information over a distance may be utilized. 

It will be apparent to those with skill in the art that there 
are many alterations that may be made in the embodiments 
of the invention described without departing from the spirit 
and scope of the invention. For example, there are many 
manifestations of the apparatus described as an example 
with the aid of FIG. 1, that would be suitable for practicing 
the invention. All of the elements of FIG. 1 are not necessary 
to practice the invention in all embodiments, and in some 
embodiments only certain selected elements are needed. For 
example, the CD-ROM drive and hard-disk drive elements 
shown are not needed in most embodiments, but might be 
used in some embodiments. 

In addition to the above, although TV broadcast from a 
remote location by any one of several methods, either live 
broadcast or pre-recorded, has been used primarily as 
examples for described embodiments above, the invention 
also encompasses other ways of providing TX signals to a 
display, and the integrated ability to respond to dynamic 
URLs. For example, TV programming with associated 
URLs may be provided on video tape to be used in a VCR, 
by signals stored on one of the hard disk drives, or by signals 
provided on a CD-ROM disk to be played in the CD-ROM 
drive shown in FIG. 1. The invention is broad enough to 
encompass any means of providing signals for TV display, 
with the signals integrated with a dynamic URL for allowing 
a user to browse the Internet WWW as a result of interacting 
with an enhanced entity in a frame of a TV display. 

Still further, there are many ways the functionality of the 
control routines required for such an apparatus, for stripping 
interframe data and for accomplishing browsing in response 
to dynamic URLs, may be provided. It is well known in the 
computer arts that specific functionality may be provided by 
control routines written in a variety of ways. It is not the 
specific order of code that is unique, however, rather the 
functionality that the code provides for the apparatus. 

Hiere are a large body of potential applications for the 
invention described in several embodiments herein. Each of 
such applications may be regarded as a new embodiment of 
the present invention rather than as a new invention. 
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There are, in addition, many formats for display of WEB 
pages with simultaneous display of TV programming, and 
the many variations possible simply attest to the breadth of 
the present invention. 

What is claimed is; 

1. A video data stream, sent in successive frames, for 
providing a dynamic video display on a display monitor, 
comprising: 

a first image frame data region providing a visual entity in 
a specific first position in the display; and first rela- 
tional data associated with the first image frame data 
region, relating the first position to a URL; 

a second image frame data region providing the visual 
entity in a second specific position other than the first 
specific position in the display, and second relational 
data associated with the second image frame data 
region, relating second position of the visual entity to 
the URL. 

2. A video data stream as in claim 1 comprising analog 
television signals wherein the relational data is interposed in 
an interval between the image frame data regions. 

3. A video data stream as in claim 1 comprising digital 
television data wherein the relational data is integrated 
directly in the image frame data regions. 

4. A video data stream as in claim 1 further comprising 
information integrated directly in the image frame data 
regions adapted for causing the visual entity to be visually 
enhanced in the display. 

5. Avideo data stream as in claim 4 wherein enhancement 
of the visual entity is by alteration of one or both of 
brightness and contrast. 

6. Avideo data stream as in claim 4 wherein enhancement 
of the visual entity comprises alteration of color signals at 
the position of the visual entity. 

7. Asystem for TV transmission providing an active video 
display for television programming, comprising: 

a source providing a video data stream sent in successive 
frames, including; 

a first image frame data region providing a visual entity in 
a specific first position in the display; and first rela- 
tional data associated with the first image frame data 
region, relating the first position to a URL; and 

a second image frame data region providing the visual 
entity in a second specific position other than the first 
specific position in the display; and second relational 
data associated with the second image frame data 
region, relating the second position of the visual entity 
to the URL; 

receiving and display apparatus adapted for receiving and 
displaying the image frame data on a display monitor, 
the receiver and display apparatus comprising also an 
Internet Browser; and 

selection apparatus for selecting the visual entity in the 
active video display; 

wherein selecting the visual entity in the active video 
display activates the Internet Browser, accesses a World 
Wide Web page addressed by the URL, and displays the 
page on the display monitor. 

8. A system as in claim 7 wherein more than one visual 
entity in the active video display is associated with a URL. 

9. A system as in claim 7 wherein the visual entity is 
enhanced in the active video display to indicate to a viewer 
that the visual entity is associated with a URL. 

10. A system as in claim 9 wherein the enhancement is by 
one of adjusting brightness or contrast, by adjusting color, or 
by adding an outline to the visuial entity. 
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11. A system as in claim 7 wherein the source is a (a) preparing a video data stream having successive 
broadcast transmitter broadcasting a TV signal. frames comprising image frame data and relational data 

12. A system as in claim 7 wherein the source is a Video from a scene using a visual imaging apparatus; and 
Cassette Recorder (VCR) playing a VCR tape. (b) inserting the URL and data relating the XJRL with a 

13. A system as in claim 7 wherein the source is a 5 position of the visual entity in each frame in the data 
CD-ROM drive playing a CD-ROM disk. stream. 

14. A system as in claim 7 wherein the source comprises 24. The method of claim 23 wherein step (b) is performed 
a computer apparatus retrieving and transmitting a video in editing pre-recorded image data. 

data stream from a hard disk drive. 25. The method of claim 23 wherein step (b) is performed 

15. A system as in claim 7 wherein the WEB page is lo automatically in a live broadcast by computerized apparatus 
displayed as a movable and adjustable window on the coordinated with the visual imaging apparatus. 

display monitor, 26. The method of claim 23 further comprising a step for 

16. A receiving and display apparatus comprising: inserting data for enhancing display of the visual entity, 
computerized control circuitry; 27. The method of claim 26 wherein the enhancement is 
an Internet browser; by adjustment of one or more of color, brightness, or 
display circuitry; ' contrast in the display 

a display monitor; and ^ method for accessing additional information related 

, ' . . J * J r • • to a moving visual image entity in a video display, com- 

receiving and processing circuitry adapted for receivmg ste s of ' 

and processing a dynamic video data stream sent in pnsing s ps o . 

successive frames, and providing therefrom an active (^) associating the moving visual image entity with a 

video display having a moving visual entity therem, the dynamic Universal Resource Locator (URL) m a data 

moving visual entity associated with a moving region ^^'^^"^ including image frames for the video display, 

in the display, and the moving region in the display data stream compnsmg a first image frame data 

associated with a single URL; ^g^^n providing the visual entity m a specific first 

wherein the control circuitry provides a selection mecha- ^ P«f ^^^^^y- f ^ ^^^^^^^^^^ .^^f 

nism adapted for a user to select the moving region in f ^ ^« *!)^ ^'^^ ima^ frame data region, relating the 

the display associated with the visual entity, and upon position to a URL, a second image frame data 

selection causes the Browser to access the Internet ^S^^^ providing the visual entity in a second specific 

source, and to download and display a WEB page 3^ P^^^^ion m the display; and second relational data 

having the URL ^ o associated with the second image frame data region, 

17. Tlie apparatus of claim 16 comprising multiple URLs P^^^^on of the visual entity to the 

associated each with a different specific entity image in the v , ' . , . , , . 

display. selecting the visual entity m the video display by user 

18. The apparatus of claim 16 wherein the WEB page is 35 input: 

displayed as a movable and adjustable window in the (c) accessing the Internet via a Network Interface Module 

display. (NIM) in response to the user input, and connecting to 

19. A signal preparation and transmission apparatus for ^he data source associated with the URL; 
providing a video data stream sent in successive frames (d) downloading a WEB page from the data source; and 
comprising: ^ (e) displaying the WEB page in the video display 

imaging apparatus for monitoring a scene and preparing a 29. The method of claim 28 wherein the WEB page is 

signal data stream therefrom, the data stream compris- displayed in the video display as a movable and adjustable 

ing a first image frame data region providing a visual window. 

entity in a specific first position in the display; and first 30. The method of claim 28 wherein user selection is by 

relational data associated to the first image frame data 45 cursor manipulation and selection with a pointer device, 

region, relating the first position to a URL; 31. The method of claim 28 wherein multiple visual 

a second image frame data region providing the visual image entities are associated each with a unique URL, and 

entity in a second specific position other than the first more than one WEB page is accessed and displayed by 

specific position in the display; and second relational selecting more than one visual image entity, 

data associated with the second image frame data 50 32. A method for associating an individual visual entity in 

region, relating the second position of the visual entity a video display with an Internet Universal Resource Locator 

to the URI^ and (URL), the video display provided as successive frames to 

control circuitry adapted for adding an Internet Universal ^ display monitor, comprising steps of: 

Resource Locator (URL) to the data stream and for (a) noting the position of the visual entity in the display 

associating the URL with the visual entity in one or 55 ^ individual ones of the successive frames; 

more of the image frames. (b) associating an areal region of the display in each of the 

20. The apparatus of claim 19 wherein the control cir- individual ones of the successive frames with the 
cuitry adds more than one URL each associated with a position of the visual entity; and 

different visual entity. (c) associating the areal region for each of the individual 

21. The apparatus of claim 19 wherein the control cir- 60 ones of the successive frames with the URL, 

cuitry adds data to the data stream to visually enhance the 33. A video data stream adapted for providing a moving 

visual entity in a display provided by the data stream. image entity in a video display associated with an Internet 

22. The apparatus of claim 21 wherein the enhancement URL, wherein the moving image entity in successive frames 
is by one or more of adjusting brightness, contrast, or color. is associated with an areal region in each frame, and the areal 

23. A method for providing association of amoving visual 65 region in each frame is associated with the URL. 

entity in a broadcast image with an Internet Universal 34. A system for providing a video television display 

Resource Locator (URL), comprising steps of: comprising: 
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a source providing a video data stream having image data 
organized in successive frames and providing a moving 
visual entity in the television display, the moving visual 
entity associated in the video data with an area in the 
display and the area associated in the video data with an 5 
Internet URL; 

receiving and display apparatus, adapted for receiving the 
video data and providing the television display 
therefrom, including the moving visual entity; 



16 

selection apparatus adapted for a user to select the moving 
visual entity in the television display; and 

an Internet browser system including a browser applica- 
tion and an Internet access link; 

wherein, upon selection of the moving visual entity by the 
user, the system initiates the Internet Browser 
application, accesses the Internet, and downloads and 
displays a WEB page associated with the URL. 

♦ ♦ * * ♦ 
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